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Test System and Method 

Background 

Electronic systems must be tested. Failure of such systems during operation is 
considered to be catastrophic in many situations (for example, space-craft and missiles). 
5 Expensive suites of test equipment have been developed to test complex, high-value electronic 
systems. These test systems are matched to the design of the system to be tested. Therefore, the 
test equipment development cannot start until the system to be tested is far down the design and 
development road, and the amount of time available to develop the test equipment is very short. 
U In addition, inevitable changes to the design of the complex system to be tested, after test 



Clio equipment development, result in a high cost to modify the test equipment to reflect that change. 

ill 

;« The test equipment is designed to a specification document, usually a "performance 



Therefore, there is a need for a test equipment system that can be changed rapidly. 



: wi specification" or a "requirements" document. During the process of designing the test equipment 

in 

Q from the performance specification, elements of the point design of the equipment to be tested 

?•» 

p tend to "leak back" into the specification. Therefore, there is a need for test equipment design 
that, while being driven by the requirements of the tests to be performed, is derived 
independently. 

Generally, test equipment can be divided into two categories. The first category is 
termed Special Test Equipment (STE). This is equipment developed to perform a specific 
20 testing function. It is not suitable for testing items other than those it was designed to test. In 
contrast, General Purpose Test Equipment is used to test many unrelated components or systems. 
Unfortunately, current stand alone General Purpose Test Equipment is unsuitable for, most 



P:\FILES\30710US\Patent Application.doc 



1 



1 

Kit 



tty Docket No. J30710US 

complex systems; the embedded functionality is too inflexible. Therefore, there is a need for a 
Several Purpose Test System that will service highly complex systems. 

For example, for missiles, onboard performance information during flight must be 
transmitted to ground receiver sites. A system of sensors, processors and telemetry transmitters 
is used to collect and transmit performance data and missile range safety tracking information to 
the ground control site. A system of ground-test instrumentation is used to check out the system 
of flight instrumentation and telemetry equipment. Currently, as the performance and tracking 
system is developed, a special test equipment suite is developed at the same time. Detailed 



j;| system test requirements documentation is not finalized until late in development; therefore, the 



start of the test equipment development effort is delayed. Furthermore, the inevitable 
modifications to the system will cause the test equipment development to incur cost and schedule 
growth. Even further, post-development alterations of the system result in a high cost 



u 

s|J modification of the special test equipment. The hard-wired architecture of the test equipment 
? f* results in a disincentive to modify system flight hardware due to the high cost of changing the 

W 

f \5 test equipment. Accordingly, there is a need to develop general purpose test equipment capable 

of handling specific systems, such as the example system above. 

There is also a need to reduce the schedule risks in development programs of test 

equipment and to provide a structure for increasing the assurance that performance requirements 

alone will drive the test equipment specification, and there is a need for test equipment design 
20 that requires a more clear and more complete definition of performance specification of test 

equipment early in the development process. 
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Brief Description of the Drawings 

Figure 1 shows a flow diagram of an example embodiment of the invention. 
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Description of Example Embodiments of the Invention 

Referring now to Figure 1, an example embodiment of the invention is seen in which 
performance specification document (PSD) is provided in an electronic form in an electronic 
document mark-up language (for example, Standard Generalized Mark-up Language (SGML)). 
According to one specific embodiment of the invention, electronic document PSD is in the 
Extensible Mark-up Language (XML). A specific advantage of the XML embodiment is that 
XML uses tags only to delimit pieces of data and leaves the interpretation of the tag completely 
to the application reading the data. According to an alternative embodiment, the electronic 
performance specification document (PSD) comprises an Hyper-Text Mark-up Language 
(HTML) document. 

As seen in Figure 1, the performance specification document includes data in fields (for 
example, Fl and F2), contained in records (Rl and R2)). The various records and fields of the 
performance specification document are included in various sections S1-S4. The sections, fields 
and records are demarked by tags and attributes defined by formatting rules. The tags and 
records include hierarchical divisions (for example, sections, jobs, blocks, steps, etc.). Further, 
the rules include which subdivisions are required and which are optional in various 
embodiments. 

According to other embodiments, the rules define which of fields Fl and F2 are required 
for the definition of the smallest record. According to one specific example, assuming a record 
is the smallest section of the performance specification document, the required fields include 
descriptions of instructions, notes, test-interface points, stimulus values, stimulus value units, 
measured values, measured value units, etc. The tags and attributes, therefore, include: (1) 
documentation related items such as hierarchical notations, titles, descriptions, and notes; (2) test 
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system related items (e.g., interface points and data codes); and (3) test specific items (e.g., 
stimulus and measurement values and units). 

According to other specific example embodiments, additional rules constraining the 
performance specification document (PSD) are derived from test specifications and testing 
requirements for the unit under test. In some specific examples, those rules include the order of 
events (testing is required, in some embodiments, to proceed in a specific order to make a valid 
assessment of some functionality of interest) and lists of acceptable units (for example, the use of 
volts as a specification may be constrained to units of V). 

Referring still to Figure 1, the performance specification document (PSD) is read by 



3<p mark-up language reader R which selectively generates delimited configuration file (DCF) 

s 

(fi and/or human readable document (HRD). Delimited configuration file (DCF) is used by general 

W 

Si) purpose test equipment (GPTE) to configure test equipment to test the system of interest (not 



shown). Human-readable document (HRD) is used by operation and quality-control personnel to 
review the design of the test. 
2} As a result of the example embodiment of Figure 1, parallel development of the test 

equipment and the system to be tested is provided, and changes to the system to be tested occur 
without changing the test system. Further, the traditional path for corruption of the performance 
specifications and requirements is eliminated by decoupling the requirements and specification 
development from the test equipment point design. Providing the detailed test parameters and 
20 the delimited configuration file DCF allows for changes to the performance specification without 
changing the hardware or detailed software design of the test equipment. Thus, development of 
test equipment occurs sooner; changes during development have less impact on test equipment 
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development; and the fully-developed performance specification eliminates the need for test 
equipment driven changes to the performance specification. 

In one specific example embodiment, a performance specification document for a system 
calls for a system battery voltage test. The performance specification document includes the 
following definitions of related XML tags and attributes in accordance with World Wide Web 
Consortium XML Standards: 



<! ELEMENT section (section_name_id, section_description, section_note* , io_block+)> 

< ! ELEMENT section_name__id (#PCDATA)> 

10 <! ELEMENT section_description (#PCDATA)> 

U < ! ELEMENT section_note (#PCDATA)> 

CI 

Si < [ELEMENT io_block ( j ob_io_block_id, io_block_description, io_block_action, 

iS io_step+)> 

4=5 <! ELEMENT j ob_io_block_id (#PCDATA)> 

tfl < ! ELEMENT io_block_description {#PCDATA)> 

?P < ! ELEMENT io_block_action (#PCDATA)> 

Hi 

<! ELEMENT io_step ( job_io_step_id, io_step_description, io_step_interf ace, 
%b nominal_value, 
»; nominal_value_units, 

tolerance_maximum__value, 
t o 1 e r a n c e_mi n imum_va 1 ue , 
f ail_response, 
2$ data_code, 
*h* test_id_prerequisite, 

test code id, 
^ performance_revision, 

notes* 
30 )> 



< 
< 
< 

35 < 

< 
< 
< 
< 

40 < 

< 
< 
< 
< 

45 



ELEMENT j ob_io_step_id (#PCDATA)> 
ELEMENT io_step_descript ion (#PCDATA)> 
ELEMENT io_step_interf ace (#PCDATA)> 
ELEMENT nominal_value (#PCDATA)> 
ELEMENT nominal_value_units {#PCDATA)> 
ELEMENT tolerance_maximum_value (#PCDATA)> 
ELEMENT tolerance_minimum_value (#PCDATA)> 
ELEMENT f ail_response (#PCDATA)> 
ELEMENT data_code (#PCDATA)> 
ELEMENT test_id_prerequisite (#PCDATA)> 
ELEMENT test_code_id (#PCDATA)> 
ELEMENT perf ormance_revision <#PCDATA)> 
ELEMENT notes (#PCDATA)> 



The performance specification document also includes the following XML test execution 
specification: 
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<?xml version="l .0" encoding="utf-8"?> 

<!DOCTYPE section PUBLIC "-//Test Requirements //EN" "performance . dtd"> 
<section> 

5 <section_name_id>K/section_name_id> 

<section_description>INSTRUMENTATION BATTERIES </section_description> 
<section_note></section_note> 
<io_block> 

<job_io_block_id>l</ job_io_block_id> 
10 <io_block_description>OUTPUT : </io_block_description> 

<io_block_action>OUTPUT</io_block_action> 
<io_step> 

<j ob_io_step_id>K/job_io_step_id> 

<io_step_description>MEASURE BATTERY VOLTAGE</io_step_description> 

15 <io_step_interface>DMMl</io_step_interface> 
<nominal_value>12</nominal_value> 
<nominal_value_units>VOLTS</nominal__value__units> 
<tolerance_maximum_value>+2</tolerance_maximum_value> 
<tolerance_minimum_value>-2</tolerance_minimum_value> 

20 <f ail_response>ALARM</f ail__response> 

^ <data_code>10000</data_code> 

^ <test_id_prerequisite>0</test_id_prerequisite> 

<test_code_id>4</test_code_id> 
Cj <perf ormance_revisionx/perf ormance_revision> 

<notes>***VERIFY BATTERY VOLTAGE* **</notes> 
y ; j </io_block> 
</section> 

k 
m 

in 

M 

Reader R, in a specific example, comprises a commercially available XML text editor 
(e.g. Arbortext Epic Editor) and several ACL text scripts written to derive a tab delimited text 

35 file that reads the XML formatted performance specification document (PSD) and generates a 
tab-delimited configuration file for use with a Sun Solaris Workstation running the Solaris 8.0 
operating system, Sybase Enterprise Server data base, and ION A Orbix common object broker 
architecture software. The Workstation is networked to an embedded VXI computer (VXI 
PC/700) with Windows NT 4.0 operating system, IONA Orbix common object broker 

40 architecture software, and NI/VISA VXI interface software. The embedded computer is 
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connected via a common VXI chassis with an Agilent E1413C scanning A/D card as the voltage 
measurement device. The Workstation ingests the delimited configuration file and executes the 
voltage measurement via a common object broker architecture client and server. The client 
resident on the Workstation invokes server methods resident on the embedded computer to 
5 control execution of the voltage measurement and perform result evaluation. 

At the selection of the operator, a document is produced from the XML document in 
human-readable form (e.g., formatted for ease of reading, such as through a word-processor or in 
columnar format) for quality control. For example, the human readable form document is 
published, in some embodiments, from the XML document using the Arbortext Epic Editor and 

3& ACL scripts. The general purpose test equipment includes a common object request broker 

m 

IXi'.i 

m 
m 
w 
$ 

fl) without departing from the spirit of the invention which is defined solely by the claims. 

W 

:W 

m 



architecture and a mark-up language enabled input that comprises reader R. 

The above embodiments are given by way of example only. Further example 
embodiments will occur to those of skill in the art upon review of the present specification 
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